All-optical neural network with nonlinear activation functions
نویسندگان
چکیده
منابع مشابه
Neural Network Initialization for Modeling Nonlinear Functions in Engineering Mechanics
This paper introduces a heuristic methodology for designing multilayer feedforward neural networks to be used in modeling nonlinear functions in engineering mechanics applications. It is well recognized that a perfect way to decide an appropriate architecture and assign initial values to start neural network training has yet to be established. This might be because such a challenging issue can ...
متن کاملComplex backpropagation neural network using elementary transcendental activation functions
Designing a neural network (NN) for processing complex signals is a challenging task due to the lack of bounded and differentiable nonlinear activation functions in the entire complex domain C. To avoid this difficulty, 'splitting', i.e., using uncoupled real sigmoidal functions for the real and imaginary components has been the traditional approach, and a number of fully complex activation fun...
متن کاملStochastic Neural Networks with Monotonic Activation Functions
We propose a Laplace approximation that creates a stochastic unit from any smooth monotonic activation function, using only Gaussian noise. This paper investigates the application of this stochastic approximation in training a family of Restricted Boltzmann Machines (RBM) that are closely linked to Bregman divergences. This family, that we call exponential family RBM (Exp-RBM), is a subset of t...
متن کاملDeep Neural Networks with Multistate Activation Functions
We propose multistate activation functions (MSAFs) for deep neural networks (DNNs). These MSAFs are new kinds of activation functions which are capable of representing more than two states, including the N-order MSAFs and the symmetrical MSAF. DNNs with these MSAFs can be trained via conventional Stochastic Gradient Descent (SGD) as well as mean-normalised SGD. We also discuss how these MSAFs p...
متن کاملOptimization of Bistability in Nonlinear Chalcogenide Fiber Bragg Grating for All Optical Switch and Memory Applications
We solve the coupled mode equations governing the chalcogenide nonlinear fiber Bragg gratings (FBGs) numerically, and obtain the bistability characteristics. The characteristics of the chalcogenide nonlinear FBGs such as: switching threshold intensity, bistability interval and on-off switching ratio are studied. The effects of FBG length and its third order nonlinear refractive index on FBG cha...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Optica
سال: 2019
ISSN: 2334-2536
DOI: 10.1364/optica.6.001132